WHAT IS CLAIMED IS: 

1. An automated video production system for online publishing of a lecture, comprising: 
a camera system that provides multiple camera views of the lecture; 

a virtual director that selects a current camera view from the multiple camera views and is 
capable changing the current camera view by switching between the multiple camera 
views in response to a triggering event; and 

a set of expert video production rules that is applied by the virtual director to select the 
current camera view. 

2. The automated video production system as set forth in claim 1 , wherein the set of 
expert video production rules is applied by the virtual director to determine to which of 
the multiple camera views to switch. 

3. The automated video production system as set forth in claim 1 , wherein the set of 
expert video production rules are applied by the virtual director to generate the 
triggering event and determine to when to switch the current camera view. 

4. The automated video production system as set forth in claim 1 , wherein the camera 
system includes a single camera. 

5. The automated video production system as set forth in claim 1 , wherein the camera 
system includes a plurality of cameras. 

e.The automated video production system as set forth in claim 1 , further comprising a 
virtual cinematographer that controls a camera in tracking an object within the lecture. 

Z.The automated video production system as set forth in claim 1 , wherein the camera 
system includes an audience-tracking camera that provides a camera view of an 
audience. 

S.The automated video production system as set forth in claim 7, further comprising a 
microphone-array audience tracker that controls the audience-tracking camera in 
tracking a member of the audience. 

g.The automated video production system as set forth in claim 7, further comprising an 



audience-tracking status nnodule that provides status information of the audience- 
tracking camera to the virtual director. 

[ci 0] 1 0.The automated video production system as set forth in claim 9. wherein the status 

information includes a plurality of possible statuses. 

[ci 1] 11 The automated video production system as set forth in claim 1 , wherein the camera 

system includes a lecturer-tracking camera that provides a camera view of a lecturer. 

[ci 2] 1 2.The automated video production system as set forth in claim 1 1 , further comprising a 

history-based, reduced-motion tracker that controls the lecturer-tracking camera in 
tracking the lecturer based on a history of the lecturer's movement. 

Ig 3] 1 3.The automated video production system as set forth in claim 1 1 , further comprising a 

m lecturer-tracking status module that provides status information of the lecturer-tracking 

^ camera to the virtual director. 

Ill 4] 1 4.The automated video production system as set forth in claim 1 , wherein the virtual 

J,. director includes an event generator that generates the triggering event. 

^ 5] 1 s.The automated video production system as set forth in claim 1 4, wherein the event 

t generator further comprises a time transition module that determines when to switch the 

current camera view. 

[ci 6] 1 6.The automated video production system as set forth in claim 1 4, wherein the event 

generator further comprises a location transition module that determines to which of the 
multiple camera views to switch. 

[ci 7] 1 7.The automated video production system as set forth in claim 1 6, wherein the location 

transition module is a probabilistic finite state machine having multiple states. 



[cl8] 



1 8.A method for automatically producing a video of a lecture for online publishing, 
comprising: 

providing a set of expert video production rules; 

capturing the lecture using a camera system that includes multiple camera views; and 
using the set of expert video production rules to determine a current camera view from 
the multiple camera views, when the current camera view should change, and to which of 
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the multiple camera views the current camera view should change. 

[ci 9] 1 9.A computer-readable medium having computer-executable instructions for 

performing the method recited in claim 1 8, 

[c20] 20.The method as set forth in claim 1 8, wherein the set of expert video production rules 

are a set of constraints for producing the video. 

[c2l] 21. The method as set forth in claim 18, wherein the set of expert video production rules 

is obtained by determining rules used by human experts in a video production field. 

[c22] 22.The method as set forth in claim 1 8, wherein the current camera view is changed in 

... response to a triggering event. 

[ilS] 23.The method as set forth in claim 22, wherein the triggering event is generated based 

ri on the set of expert video production rules. 

Iik4] 24.The method as set forth in claim 1 8, wherein determining to which of the multiple 

camera views the current camera view should change is based on probabilistic approach. 

Ills] 25.The method as set forth in claim 24, wherein the probabilistic approach uses a 

V probabilistic finite state machine having multiple states that are fully connected to allow 

O transition from one state to another. 

[c26] 26.The method as set forth in claim 1 8, wherein the camera system includes an 

audience-tracking camera that provides a camera view of an audience of the lecture. 

[c27] 27.The method as set forth in claim 26, further comprising using the set of expert video 

production rules to control the audience-tracking camera in tracking of members of the 
audience. 

[c28] 28.The method as set forth in claim 1 8, wherein the camera system includes a lecturer- 

tracking camera. 

[c29] 29.The method as set forth in claim 28, wherein the lecturer-tracking camera tracks the 

lecturer using the set of expert video production rules. 

[c30] BO.The method as set forth in claim 28, wherein the lecturer-tracking camera tracks the 

lecturer based on a history of the lecturer's movement. 
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31 .An automated video production system for capturing images of a scene, comprising: 
an audience-tracking camera that provides Images of an audience within the scene; 
a lecturer-tracking camera that non-intrusively tracks a lecturer within the scene; 
a set of expert video production rules containing video production constraints; and 
a virtual director module that receives multiple camera views from the audience-tracking 
camera and the lecturer-tracking camera and uses the set of expert video production 
rules to select an current camera view from the multiple camera views. 

32. The automated video production system as set forth in claim 31 , further comprising 
an overview camera that provides an overview image of the scene. 

33. The automated video production system as set forth in claim 31 , wherein the current 
camera view is capable of changing to one of the multiple camera views in response to a 
triggering event. 

34. The automated video production system as set forth in claim 33, wherein the set of 
expert video production rules is used to determine when the triggering event is 
generated. 
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